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Abstract — In a multi-access channel, completion time refers to 
the number of channel uses required for users, each with some 
given fixed bit pool, to complete the transmission of all their 
data bits. In this paper, the characterization of the completion 
time region is based on the concept of constrained rates, where 
users' rates are defined over possibly different number of channel 
uses. An information theoretic formulation of completion time 
is given and the completion time region is then established 
for two-user Gaussian multi-access channel, which, analogous 
to capacity region, characterizes all possible trade-offs between 
users' completion times. 

I. Introduction 

Multi-access channel (MAC) is an important channel model 
that finds many applications in wireless networks and has 
drawn substantial research attention in the literature. Tradi- 
tionally the study of MAC is guided under two different 
philosophies. Information theoretic approach assumes users 
have a full buffer all the time and strives to characterize the 
fundamental limits of transmission rates by focusing on the 
interplay of noise and interference DDE]. In contrast, network 
oriented studies usually focus on addressing issues arising 
from bursty packet arrivals and view the multi-user channel 
as a collection of single user channels by adopting a collision 
model J3j , treating interference as noise or orthogonalization 
in time or frequency domain. The discrepancy between these 
two lines of work has been well documented in AUG!. In this 
paper, we use information theoretic tools to study a problem, 
which deviates from the usual information theoretic setup and 
has a flavor of network theory, namely the completion time in 
multi-access channel. The completion time problem attempts 
to incorporate the notion of delay into the information theoretic 
study of MAC. 

This paper considers a periodic source arrival model, where 
a new block of data arrives very n channel uses. Hence during 
each block of n channel uses, user's data buffer is not to be 
replenished and the usual full-buffer assumption is no longer 
valid. One example of this would be users sending large files 
of fixed sizes, in which case we only have a single channel 
block. For another example, consider two users streaming live 
videos that are compressed at possibly different but fixed rates 
to a common receiver. The data arrives periodically. In the 
beginning of each period, each user has a certain number of 
bits to send. However due to the casuality constraint, after 
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the completion of the current transmission, users will have to 
wait until the next period to obtain new data to send. We 
model this as the follows: user i, i = 1,2, has tot; bits, 
with niTi corresponding to the file size in the file example 
and Tj corresponding to the compression rate in the streaming 
example, to transmit in at most n channel uses, where n 
is assumed to be large enough to allow the completion of 
both transmissions. Let rii < n be the actual number of 
channel uses that user i spends on the transmission. We 
are interested in the normalized completion time (hereafter 
referred as "completion time") within a single channel block, 
which is defined as m/m in the limit of large m and m. Note 
that in the streaming example, m corresponds to the number 
of source samples, which is assumed to be the same for both 
users. In general we can view m as a scaling factor to ensure 
information theoretic arguments with large block lengths can 
be invoked. The exact value of m is not important since it will 
not appear in the characterization of completion time. 

The main contributions of this paper are an information 
theoretic formulation of completion time and the derivation 
of the completion time region for two-user Gaussian multi- 
access channel (GMAC), which, analogous to capacity region, 
characterizes all possible trade-offs between users' completion 
times. Compared with [6], where the authors solved the sum 
completion time minimization problem for a X-user symmet- 
ric GMAC, our result provides a more general formulation 
for the two-user case. In [7|, the authors considered an in- 
terference channel where each user has backlogged packets of 
equal size to transmit and the goal is to leverage power control 
to minimize some convex cost function over the completion 
time region. In |7|, the completion time region is obtained by 
treating interference as noise, whereas in this paper, we adopt 
an information theoretic approach without restricting ourselves 
to any specific coding scheme such as treating interference as 
noise. 

This paper is organized as the follows. In Section II, the 
concept of constrained rates is introduced, based on which 
completion time is then defined. In Section III, the completion 
time region for two-user GMAC is derived. Applications of the 
obtained completion time region and extensions of this work 
are discussed in Section IV. 

Notation: Let 7(0;) = ilog 2 (l + x). 
{X k ,i, —,Xkj) for i < j and X{ 



Also let X 3 hfi = 
= {Xk,i, ...,Xk,j). 



X 3 k . does not appear if i > j. [X] + — ma,x{X, 0}. We use 
bold font for vectors and calligraphic font for regions. 

II. Problem Formulation 

In information theory, it is commonly assumed that a user's 
data buffer is always full and therefore the goal is to devise a 
coding scheme that can reliably transmit as much information 
as possible in a given number of channel uses. However, in 
our setup, the total amount of information to be transmitted 
for user i is limited to mr* bits in at most n channel uses. 
Hence having some users finish early is not only desirable to 
reduce to completion time of those users, but also preferable 
for the remaining users since they can enjoy reduced multi- 
user interference in the remaining period. In order to capture 
this, and to formulate the completion time problem, we will 
define communication rates over different number of channel 
uses for each user, as opposed to the standard definition in 
multi-user information theory, where users' codewords span 
the same block length. We refer this as constrained rate, which 
will be first defined through a two-user discrete memoryless 
multi-access channel (DMMAC) in subsection II. A. We then 
give a formal definition of completion time in subsection II. B. 

A. Constrained Rate 

Consider a two-user DMMAC {X\ x X 2 ,p(y\xi,x 2 ),y), 
where X\ , X 2 are the input alphabets, y is the channel output 
alphabet and x%) is the channel transition probability. 

Let us denote n = maxjrii}, i = 1, 2, and c = n\jni. We 
will let n% and n 2 vary with c fixed. For i = 1, 2, i = {1, 2}\i. 
Also let 



R* = maxI(X l ;Y\X- l 



1,2, 



(1) 



where fa = argmax^g^j max Px I{Xi\ Y\Xj — fa. One can 
view fa as the symbol that "opens" up the channel from user 
i to the receiver the most. 

Definition 1: A ((Mi, M 2 ), m, n 2 ) code consists of mes- 
sage sets: Wj = {1, ...,Mj}, two encoding functions, 

X l :W l ^(X^,fa^ +l ) fori = 1,2 

and two decoding functions 

<), ■ y ► W, fori = 1,2 

Note that user i will send fa during the n — rii symbols at the 
end of its codeword. 

Users independently choose an index Wi uniformly from 
Wi and send the corresponding codewords. The average error 
probability for the ((Mi, M 2 ), n\, n 2 ) code is 

P e = Pr( 5 i(y ni ) ? W x or g 2 {Y n2 ) ^W 2 ). 



Definition 2: For a ((Mi, M 2 ),ni,n 2 ) code, the c- 
constrained rates are defined as, for i = 1, 2, 



Ri — 



i 0g2 (Mi ; 



The c-constrained rate pair (Ri ,R 2 ) is said to be achievable 
if there exists a sequence of ((Mi, M 2 ),ni,n 2 ) codes with 
P e — > as n — > oo. The c-constrained rate region, denoted 
by TZ C , is the set of achievable c-constrained rate pairs for a 
given coding scheme. The c-constrained capacity region C c is 
the closure of all Tic- 
Remark 1: We use the term "c-constrained rate (capacity) 
region" to emphasize the fact that user i's effective codeword 
length is constrained by n, channel uses over which Ri is 
defined (the remaining channel uses are padded by fa) and 
the rate (capacity) region is a function of c = rii/n 2 . Hence 
72.1 (Ci) is the standard rate (capacity) region, where m = n%. 
Lemma [T] and Theorem [U which will be stated next, reveal 
the connection between the c-constrained rate (capacity) region 
and the standard one. 

Lemma 1: The c-constrained rate pair (Ri,R 2 ) is achiev- 
able, for some c ^ 1, if: 

1) c < 1, R 2 can be decomposed into R' 2 and R 2 : R 2 = 
cR' 2 + (l- c)R%, such that (Ri,R' 2 ) 6 C x , R' 2 ' < R* 2 ; 

2) c > 1, i?i can be decomposed into R[ and R'{: R x = 
\R'i + (1 - \)R'(, such that (R[,R 2 ) 6 C x , R'{ < R$, 

where R* is defined in (03 . 

Proof: The proof is relegated to Appendix |A] ■ 
Theorem 1: The c-constrained capacity region C c for some 
c 7^ 1 is the set of all rate pairs (Ri, R 2 ) satisfying 

1) c<l, (R u [\R 2 - (i - l)R* 2 ]+) G Ci; 

2) o 1, ([ci?i - (c - l)R$} + , R 2 ) e Cx, 

where C\, the standard two-user DMMAC capacity region, is 
the closure of the set of all (r x , r 2 ) pairs satisfying 

ri<I(X 1 ;Y\X 2 ,Q), 
r 2 <I(X 2 ;Y\Xi,Q), 
ri+r 2 <I(X 1 ,X 2 ;Y\Q) 

for some choice of the joint distribution 
p(q)p(x 1 \q)p(x 2 \q)p(y\xi,x 2 ) with \Q\ < 4. To avoid 
confusion, hereafter we use lower-case r and upper-case R to 
refer to the standard and constrained rates respectively. 

Proof: The proof is relegated to Appendix iBl ■ 
Now let us consider the following two-user GMAC: 



Y = Xi + X 2 



Z, 



(3) 



where Z ~ Af(0, 1) is the i.i.d. Gaussian noise process and 
inputs are subject to per symbol power constraints: E[Xf] < 
Pi. The standard capacity region of two-user GMAC is 



C?= (ri,r 2 ) 



< 



iefi 



ri<7($Z P <). nc{l,2}l. (4) 
ien ) 



bits per channel use. 



(2) 



To avoid confusion, hereafter we use lower-case r and upper- 
case R to refer to the standard and constrained rates respec- 
tively. Note that for the GMAC, fa = 0, i.e. user i stays silent 
after it completes the transmission in m channel uses. 

Corollary 1: The c-constrained capacity region C^P of two- 
user GMAC is the set of non-negative rate pairs (Ri,R 2 ) 



satisfying: 

Ri < l(Px), R2 < i(P 2 ), 
max(l, c)Rx + max(l, \)R 2 < (c-l) 7 (P 1 )7 

+ (±-l) 7 (P 2 )I+7(P 1+ P 2 ), 

where 1=1 — 1 and / is an index function: I = 1 if c > 1; 
I = Q if c < 1. 

Proof: The proof mostly follows from Theorem Q] The 
achievability is obtained by using Gaussian input distribution. 
Substituting Cp for C\ and 7 (Pi) for R* in Theorem Q] the 
above expression can be derived after some manipulation. The 
converse follows from the converse of Theorem Q] and the fact 
that (fTTT i. ( fToT ). ( fl9l ) and R* are maximized by Gaussian input 
distribution under the per symbol power constraints: E[Xf] < 
P. ■ 

B. The Notion of Completion Time 

Consider a two-user DMMAC, where each user has rtiTi 
(;i = 1, 2) bits to send to a common receiver. 

Definition 3: We define the normalized completion time as 
di = n-i/m, where rii is the actual number of channel uses 
that user i spends on transmitting mTi bits. 

Because of the relation log 2 (Mi) = n. L Ri = mTi in (f2]i, 
where Ri is the c-constrained rate, we have di — Ti/Ri. 
Completion time pair (di,^) is said to be achievable if 
(ri/di, r 2 /d 2 ) is an achievable c-constrained rate pair, i.e. 
(ri/dx, r 2 /d 2 ) £ Tic where c = n\jn 2 = d\/d 2 . The 
achievable completion time region for a given coding scheme 
is V = {{d 1 ,d 2 )\{T 1 /d 1 ,T 2 /d 2 ) £ Tl dl / d2 }. Analogous to 
capacity region, we can also define the overall completion 
time region V* as the union of all achievable completion 
time regions, or equivalently T>* = {(di, d 2 )\(ri/di, T 2 /d 2 ) £ 

Cd 1 /d 2 }- 

III. Completion Time Region for Two-user GMAC 

In this section, we establish properties of T>* and compute 
it for two-user GMAC. Notice that an achievable completion 
time pair (di,d 2 ) is defined in terms of c-constrained rate 
pair, which in return depends on (di,d 2 ) through c = d\jd 2 . 
Hence it is easy to check for a given (di, d 2 ) whether or not 
it is achievable, but difficult to directly compute all pairs of 
(di,d 2 ) G V* using the definition because of this recursive 
dependence. Another difficulty in determining V* is that it is 
not always convex, as we shall show later in Theorem [3] To 
walk around these obstacles, we characterize two sub-regions 
of T>* seperately and the union of the two will lead us to T>*. In 
subsection III. A, we first show that the sub-regions are always 
convex. In subsection III.B, we consider the weighted sum 
completion time minimization problem over the sub-regions 
for two-user GMAC, which will be used in subsection ETC 
to show the achievability and converse when we establish the 
sub-regions and hence V* . 



A. Convexity of Sub-regions of T>* 

Proposition 1: V* contains two convex sub-regions, V\ 
and £> 2 , where 

V\ =V*f){(d 1 ,d 2 )\d 1 <d 2 }, 

v; = v*f){(d 1 ,d 2 )\d 1 >d 2 }. 

Proof: We prove for T)\, i.e. di < d 2 . The case of 
follows similarly. For d, d' £ T>\, we need to show d" = 
ad + ad' £ £>*, where < a < 1 and a = 1 — a. 

Suppose d = (di, d 2 ) is an achievable completion time pair. 
We consider the transmission scheme pictorially depicted in 
Fig [T]a. In the first n\ = md\ channel uses, the two users 
employ some coding scheme, denoted by SCH\, where proper 
decoding is required at the end of n\ channel uses to ensure 
messages sent in this time interval are received correctly. In 
the remaining n 2 — ri\ = m(d 2 — di) channel uses, coding 
scheme SCH 2 is employed at user 2 while user 1 sends <\>\. 
The decoding for this part of user 2's message is done at the 
end of n 2 — n\ channel uses. Note that by Theorem Q] and 
Lemma Q] we can view user 2's message consisting of two 
independent parts for n\ and n 2 — n\ channel uses respectively. 
Similarly for d', we consider coding schemes SCH[ and 
SCH 2 shown in Fig [T]b. Based on the coding schemes for 
d and d', we construct a new coding scheme, depicted in Fig 
[T|c. Since during each sub-interval error probability can be 
driven arbitrarily small, the overall scheme is reliable. The 
completion time achieved by this scheme for user i (i = 1, 2) 
is = ac r _|_ Qifjf Furthermore, since di < d 2 and 

d[ < d! 2 , we have adi+ctd[ < ad 2 +ad' 2 . Therefore d" £ T>\. 
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Fig. 1. Sub-figures a, b and c depict the transmission schemes that achieve 
d, d' and d" respectively. 

Remark 2: The proof of Proposition Q] relies on the condi- 
tion that for d, d' if di < d 2 , then d[ < d' 2 , vice versa. Without 
this condition, it is impossible to derive a simple transmission 
scheme, based on the coding schemes for d and d' respec- 
tively, that achieves the convex combined completion time d". 
This is because, in this case, the codewords in different sub- 
intervals will not be aligned, as opposed to the case shown in 
Fig [He., and thus we cannot argue that the decoding in each 



sub-interval (hence for the overall transmission scheme) will 
be successful. 

B. Weighted Sum Completion Time Minimization Problem 

For the remainder of this paper, we will focus on GMAC. 
In this subsection, we solve the following weighted sum 
completion time minimization problem: 



minimize d s = wd\ + wd2 
subject to (di,d 2 )s£>*, i = l,2 



(5) 



where w — 1 — w and w € [0,1]. We first transform <(5j into 
an equivalent problem using the connection between the c- 
constrained capacity region and the standard capacity region 
described in section II. A. We begin by introducing some 
notations. Define 



w 



Tl 



Mm 



ur 2 ) 



Di 



' R* ^ R*ri ' ^ ~ W Rl "r i?*r 2 

where R* = j(Pi), i.e. (Q]i evaluated for Gaussian channel 
(f3]l. We use -Dj(r) to denote the value of Di evaluated at 
r = (ri,r 2 ). We also define 



ri | T 2 (R* 1 -wr 1 ) 



(6) 



C?,i=C?P\{(n,r 2 )\%<%} 
C 1 G 2 =Cffl{(r-i,r 2 )|^>^} 



where Cp is given by (0). 

Proposition 2: The following optimization problem is 
equivalent to ©: 



minimize 



subject to 



A 

(ri,r 2 ) 6^, i 



(7) 



1,2 



We use £)* to denote the optimal value in ||7). 

Proof: Let's first consider (© with i = 1, i.e. di < di 
according to the definition of T>\ in Proposition [T] (di,d 2 ) £ 
T>1 implies, by definition, (ri/di, r 2 /d 2 ) £ C®, where c = 
d\/d2 < 1. Without loss of generality, consider R! 2 ' = -R 2 > i- e - 
letting user 2 transmit at the maximum point to point rate in 
the second phase in order to minimize its delay. According to 
Theorem Q] for some (ri,r 2 ) 6 Cp , we have r% — R\ and 
r 2 = -i?2 — {h ~ 1)^?2' where (i?i,i? 2 ) is an achievable c- 
constrained rate pair. Substituting Rj = Ti/di and c = di/d 2 , 
we have the following relations: 



di = ^L. 



T2 



(fl;-r 2 )n 



(8) 



Hence d s = wdi + wd 2 = A for c < 1. Furthermore d\ < <i 2 
reduces to — < — . Following the same steps, we can show 



ti , (R* 1 -r 1 )T 2 



da 



(9) 



and d„ 



D 2 for c > 1. Also di > d 2 reduces to ^ > la. 



Therefore, the optimization problem (0 is equivalent to ([5|). 

■ 

Before we solve @, we introduce some more notations. 
Let A and P, shown in Fig [2] denote the two corner points 
of Cp in ©, where A = ( 7 (Pj + P 2 ) - 7 (P 2 ), 7 (P 2 )) and 
B = (7(Pi),7(Pi + P 2 ) - 7(Pi)). Let point C denote the 




Case I 



Case II 



Case III 



Fig. 2. There are three cases of the position of point C, the intersection of 
the line ra/ri = T"a/Ti and Cp. 



intersection of the line r 2 /Yi = t 2 /ti and Cp. We define 
three cases depending on the position of point C: 



1) Case I: < 

7 Tl — 



7(Pi+P2)-7(fi) 



7(P2) 



2) Case II: 7( 't^) ^ < £ < r ...... , ... ,,>.., 

r^ 7 (P 1+ P 2 ),_a_ 7 (p - 



^)); 



' C=(^ 7 (P 2 ),7(P 2 )). 



C ^ri+T 2 

3) Case III: a > ^ 

7 Ti — 7(fi+P 2 ) 

One can think of equations © and (O as functions that 
map a rate pair (ri,r 2 ) to a completion time pair depending 
on whether d\ < d 2 or d\ > d 2 . Hence we use dj(r) to denote 
the completion time pair (di, d 2 ) evaluated at rate r = (7*1, r 2 ), 
where © is used if i = 1 and (0 is used if i = 2. 

Theorem 2: The solution to the optimization problem © 
is summarized in Table III where w\ = 7< - Pl tr 2 i > d 7 ^ 2 ' 1 and 



"'2 



_ 7 (Pi) 
_ j(Pl+P 2 )- 



TABLE I 







Case I 


Case II 


Case III 


i - 1 


IK G [0, iki] 


61(C) 


di(C) 


di(AJ 


id g (u>i, l] 


di(6') 


di(^) 


di(B) 


i - 2 


IK G [0, W2I 


d a (A) 


62(A) 


62(C) 


w G (u>2, 1] 


6.2(B) 


62(C) 


62(C) 



Proof: The proof is relegated to Appendix [C] ■ 

C. Completion Time Region 

Before presenting the main result on the completion time 
region, we also provide an outer-bound of T>* . According to 
CorollaryQ] the constrained rate Ri, i = 1,2, is upper-bounded 
by the point to point rate 7 (Pi)- Hence user i's completion 
time is lower-bounded by Tj/ 7 (Pj). 

Lemma 2: V* is outer-bounded by V°, i.e. V* C 2?°, 
where V° = {(di,d 2 )|di > ri/ 7 (Pi),d 2 > t 2 / 7 (P 2 )}. 



d 2 


/; 




,F 






di = d 2 






- 


B 








■A G 







i, = d 2 



v\ 



v% 



A = djM) B = d 2 («) C = d,(C) ^ a A 2 (K) B = d,(B) C = d,(C) /I = i^A) B = d,(fl) C = d 2 (C) 

Case I Case II Case III 

Fig. 3. The completion time region T>* = T>\ [J T>%. 

Theorem 3: The completion time region T>* of two-user 
GMAC (illustrated in Fig. is the set of pairs (di,d 2 ) 
satisfying the following: 



1) Case I 



7(Pi)<ii >n, j(P 2 )(h>T 2 , 
7 (Pi)rfi + [7(^1 + Pi) - i{P\)]di > n 



2) Case II 



h(Pi + p 2 ) - i{Pi)\di + i{P 2 )d 2 > n 
7 (Pi)di + [ 7 (P + P 2 ) - i{Pi)]d 2 > n 



T 2 . 



T 2 , 
T 2 - 



3) Case III 

7 (Pi)di >n, 7(P 2 )d 2 >r 2 , 

[7(^1 + P2) - i{P 2 )]dx + i{P 2 )d 2 > n + r 2 . 

Proof: We will first characterize 2?J and 2?2 separately 
and the union of the two gives us V* . We prove Case I. The 
others follow similarly. 

We first prove V\ = {(di,d 2 )Mi > n/7(Pi),di < d 2 }. 
For the achievability, notice that, by TheoremlH C = di (C) = 
(r 1 / 7 (Pi),ri/7(Pi)) solves ©. Thus C e £>J, i.e. C is 
achievable. Referring to Fig.[3]Case I, any point on the ray CH 
is achievable. This is because we can use the same codebooks 
designed for achieving C but decrease the rate of user 2 by 
only using part of the codewords, resulting in the same d\ 
but a larger d 2 . For the same reason, any point on the ray 
CP is also achievable (here we keep the same codebooks but 
decrease the rates for both users by the same amount). Any 
inner point of T)\ can be expressed as the convex combination 
of two points, one from CH and one from CF, and hence 
is also achievable due to Proposition Q] The converse follows 
from the outer-bound provided in Lemma [2] and the definition 
of T>\ in Proposition Q] that di < d 2 . 

We now prove V* = {(di,d 2 )|d x > T 1 /~f(P 1 ),d 2 > 
T 2 / 1 {P 2 ),d 1 > d 2 , 1 (P 1 )d 1 + [ 7 (Pi + P 2 ) - 7 (Pi)]d 2 > 
Ti + t 2 }. For the achievability, notice that 



A = d 2 (A) = 



_ ( ri7(P 2 )+T 2 ( 7 (Pi)+7(P 2 )-7(P 1 +P 2 )) 



B 



i( B ) = (tITT)' 7(Pi+P2 _ )-7(^i) / 

are achievable since they solve (0. Similar to the above 
argument, any point in is achievable. For the converse, 
the first three inequalities defining follow from the outer- 
bound in Lemma [2] and the definition of T>\ in Proposition 
Q] Next we argue by contradiction that the fourth inequality 
(corresponding to the line connecting A and B in Fig. [3] Case 
I) has to hold for any achievable completion time pair. Suppose 
there exits a point d' e £> 2 such that 7(Pi)d' 1 + [ 7 (Pi +P 2 ) - 
7 (Pi)](f 2 < ti +t 2 . Hence for the weight w 2 = ^p^j^, d' 
results in a smaller weighted sum completion time than that of 
d 2 (yl). This contradicts with the fact that d 2 (A) minimizes 
weighted sum completion time for the weight w 2 in Case I 
according to Theorem [2] 

The union of T>\ and £> 2 gives us the expression of T>* 
shown in Case I. ■ 

Referring to Fig. [3] which depicts three possible shapes of 
T>* depending on the ratio of t\ and r 2 , as we can see, V* is 



not convex in Case II. This can be verified by inspecting the 
slopes of line AC, AB and BC, which are 



Tl 
T 2 : 



and 



7(-Pl+-P2)-7(f2) 

7(^2) 



l(Pl+P2)-~f(Pl)> 

respectively and are sorted in 



ascending order according to the definition of Case II. 

IV. Discussions 

Network design often incorporates the goal of optimizing a 
certain utility function, which for example can be a function of 
users' rates. Besides rate, another performance metric that is 
often of interest is delay. Equipped with the completion time 
region, one could optimize a utility that is a function of users' 
completion times. In this section, two particular optimizations 
are sought: minimization of the weighted sum completion 
time and minimization of the maximum completion time. The 
obtained solutions are information theoretically optimal in the 
sense that no reliable communication system can achieve a 
lower value. 

First let us revisit the weighted sum completion time 
minimization problem (O with the feasible set T>i being 
replaced by the whole completion time region V* , i.e. con- 
sider min^ ,d 2 )ev* w di + wd 2 . The solution is given in the 
following theorem. 

Theorem 4: The minimum weighted sum completion time 
for the two-user GMAC defined in (0 is given by Table Hfl 
where W\, w 2 are defined in Theorem|2] W3 = T ^ T2 and Di(-) 
is defined in (0. Furthermore, the minimum value is attained 
at point di(r), where r is either A or B accordingly. 

TABLE II 



Case I 


Case II 


Case III 


D 2 (A), w G [0,u> 2 J 


D 2 {A), w G [0,w 3 \ 


Di(A), w G [0,wi\ 


D 2 {B), w e {w 2 ,H 


Di(B), w G (w 3 ,l\ 


Di(B), w G (wi, 1J 



Proof: Referring to Fig. [3] imagine there is a line with 
some fixed negative slope s that moves towards the origin. 
When this line becomes tangent to V* , the tangent point 
will solve the weighted sum completion time minimization 
problem with the weight w = — §j. It is easy to see that the the 
problem is solved at either A or B depending on the weight. 
The weight, for which A and B result in equal weighted sum 
completion time, is determined by the slope of line AB and 
is given by Wi for each case. The detailed proof is technical 
and hence omitted. ■ 

Next consider the maximum completion time minimization 
problem: d m = minmax( [;i!d2 ) e x>*{di, d 2 }. 

Theorem 5: The optimal value d* n of the above minimax 



Case I 


Case II 


Case III 


Tl 


ri+r 2 


T2 


7(Pl) 


f(Pi +P2) 


7(^2 ) 



Proof: Referring to Fig. [3] We will show the mini- 
max problem is solved at point C for all cases. Hence 
the optimal value is given by the component of C 
(note that C has equal components). Consider d m ,i = 
minmaxdgu*{di, d 2 } = mindeu* d 2 . Referring to Fig. [3] 
the minimum value d* n l is attained at point C. Similarly for 



d m ,2 = minmax de x>|{di,d2} = min de pj d\, d* m2 is also 
attained at C. Hence d* n = min{d^ 1; d* m 2 } is attained at C. 

■ 

The information theoretic formulation of completion time 
discussed in this paper is based on the concept of constrained 
rates introduced through a two-user DMMAC. For the special 
case of GMAC, the explicit completion time region is then 
obtained. Since the Gaussianality of the channel does not come 
into the picture until the explicit formulation of the mini- 
mization problem in subsection III.B, all prior observations, 
particularly the convexity of sub-regions of the completion 
time region, also apply to a general MAC. Furthermore, it is 
not difficult to see that the concept of constrained rates is not 
unique to MAC and is applicable to other multi-user channels 
as well. Consequently, one line of further work is to study the 
completion time problem for other multi-user channels under 
the information theoretic framework introduced in this paper. 
This approach is pursued in |9l . 
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Appendix A 
Proof of LemmaQ] 

Proof: We prove for c < 1, i.e. n\ < n%. The case 
c > 1 follows similarly. Consider time sharing between the 
coding scheme, which achieves (Ri,R 2 ) E C\ in the first 
n\ channel uses, and the coding scheme, which achieves rate 
R'2 < R 2 f° r user 2 in the remaining n 2 — n\ channel uses 
while user 1 transmits symbol </>±, Since in each sub-interval 
error probability can be made arbitrarily small, the overall time 
sharing scheme is reliable. User 2's overall rate therefore is 
given by R 2 = log 2 (M 2 )/n 2 = [niR' 2 + (n 2 - ni)R 2 ]/n 2 = 
cR' 2 + (1 — c)R 2 . Therefore (i?i,i? 2 ) is an achievable c- 
constrained rate pair. It is necessary to point out a likely 
false conclusion resulting from the time sharing argument: 
user l's overall rate is cR\, instead of R%, because in the 
remaining 1 — c fraction of time user 1 transmits at zero 
rate. This conclusion neglects the fact that user l's rate 
Ri = log 2 (Mi is defined over n% (not n 2 ) channel uses. 



Appendix B 
Proof of Theorem[T] 

Proof: We prove for c < 1, i.e. n\ < n 2 - The case c > 1 
follows similarly. The achievability follows from Lemma Q] 
Specifically for R 2 < (l-c)i^, set R' 2 = and R'{ = j^R 2 . 
Fori? 2 > (l-c)Rl, set R' 2 = \R 2 -{\-l)R* 2 and R 2 = R* 2 . 

The converse is as the following. Let Q denote a uniformly 
distributed r.v. on {1, n%}. For an arbitrarily small e, 

-n x e < I{X^;Y ni ) (10) 
<niJ(Xi;y|X 2 ,Q) (11) 

where ( fTol > is due to Fano's inequality and data processing 
inequality. Detailed steps from ( fTob to (fTTT i can be found in 
equations 15.104-15.113 in section 15.3.4 0. 

Similarly, due to Fano's inequality and data processing 
inequality, we have 

n 2 {R 2 - e) 

< I{X r 2 L2 :Y n2 ) 

< I{X?\X^ i+1 ;Y n \Y£ +l \X^) (12) 
= I{X? ■ F»> \X? ) + I(X^ ■ Y£ +1 \X? , ) 

_L T(Y n 2 ■ V n 2 \Y n l Y n l\ 

+ - z l A 2.n 1 +i> r m+il A i > A 2 ) 
= /(AT ; Y ni \X^ ) + /(AT ; Y% +1 \X?* , Y ni ) 

+ i(x% 1+ i ; Ci I *T , 1 ,v ni ) d3) 

= /(AT ; Y^ | A™ 1 ) + /(AT , X^ ni+1 ; Y^ +1 \X^ , Y ni ) 
= I(X r 2 11 ; I-* |A" X ) + I(X 2 % +1 ; Y% +1 \X? , Y ni ) 

+ I(X^ ; Y£ +1 , Y^ , X^ ni+1 ) 
= I(X^-,Y^\X^) + I(X^ ni+1 -Y^ +1 \X^,Y^) (14) 

< /(AT;Y"*|AT) + I(X% ll+1 ;Y% +1 \4% ni+1 ) (15) 

where (fT2l is due to conditioning reduces entropy and X\ and 
X 2 are independent, ( TT31 is because Y ni is independent of 
others conditioned on A™ 1 and X 2 \ (TBI is because Y^ +1 is 
independent of others conditioned on X 2 2 ni+1 , ( TT5T > is due to 
conditioning reduces entropy, Y™* +1 is independent of others 
conditioned on X 2 2 ni+l and the fact that <j>\ is a constant. 
Using the argument in section 15.3.4 (|J, it can be shown 
I(X^;Y ni \Xl 11 ) < mI(X 2 ;Y\X 1 ,Q). Considering a DMC 
with channel transition probability p(y\xi = (/>i,x 2 ), we have 
nxZ 1+ iXn+i\<f>Z ll+1 ) < (n 2 ~n 1 )Rt, where R* 2 is 
defined in ([TJ. Therefore we have 

\B,2 ~ (| - 1)RZ ~b< I(X 2 ;Y\X 1 ,Q). (16) 

Again due to Fano's inequality and data processing inequality, 
we have the sum rate upper-bound 

ni-Ri + n 2 R 2 - n 2 e 

= i(x^ , x^ ; r ni ) + KXi 1 , AT ; Ci \ Yni ) 
+ ^ 3 „ 1+1 ;C 1 2 +1 |AT,AT) 

+ J l A 2,ru + l' r l A l ' A 2 ' r m + lJ 



= I{X^ , ; F" 1 ) + I(X^ , X^ ; Y^ +1 \Y n > ) 

+ I(X%n 1+ l> Ol 1*1 * , ^2 1 , i"" 1 ) d7) 
= /(XI 11 , X 2 "> ; Y"> ) + I(X^ , X? , \Y ni ) 

= I(X^ , X^ ;Y^) + I{X^ ni+1 ; Y^ +1 \Y^ ) 



I(X?,X?;Y2? +1 \Y>»,X. 



ri2 \ 

2,711 + 1/ 



< I{X?\X?;Y^) +I(X2* ni+1 ;Y£ +1 \<t>?* ni+1 ) (18) 

where dPTl ) is because F" 1 is independent of others condi- 
tioned on X™ 1 , Xj 1 , (fT8l is due to conditioning reduces en- 
tropy, y^" 2 +1 is independent of others conditioned on X^ n . 1 
and the fact that 0i is a constant. Therefore we have 

Ri + \Ri - (i - l)i?2 - ^ < /(X l7 X 2 ;r|Q). (19) 

Note that the mutual information terms on line (fTTT i, (TToT l 
and ( fT9l > altogether define the standard MAC capacity region. 



Appendix C 

Due to the equivalency of the two problems, to solve 01, 
we consider (0. Note that (O is a non-convex optimization 
problem since the objective function is not convex. Fortu- 
nately, using the following Lemma, we can obtain a closed 
form solution. 

Definition 4: Let Rj? be a convex subset of R 2 . A point 
r x G R 2 , is an extreme point iff whenever r x = tr y + (1 — t)r z , 
t G (0,1) and Y y ^ r z , this implies either r y g R 2 . or r z M^. 

Definition 5: An extreme point r x € R 2 is said to be 
dominant iff there does not exist extreme point r y G M^, 
Y y ^r x , such that r x < r y element- wise. 

Lemma 3: The minimum value of is attained at domi- 
nant extreme points of C^. 

Proof: Assume i = 1. The case i — 2 can be obtained 
similarly. Suppose G C± x is not an extreme point, i.e. there 
exist points r y ,r z G Cp l5 and r y ,r z ^ r x such that lies 
on the line segment, of which the end points are r y and r 2 . 
Let this line segment be represented by ari + br 2 = 1. Next 
we evaluate D\ (0 along this line segment. 

1) For b ^ 0, without loss of generality, suppose n tV < 
Tx,x < r\ t g. We have r 2 = 1 ~£ Tl and thus Di = wj^- + 

— + which is an increasing function of 



a 

it'!, 



ri if i?2 _ i w < or decreasing if i? 2 - |iu > 0. There- 
fore we have min{Di(r x ), Di(r„), £>i(r*)} 7^ #1(1^) 



2) 



unless i?! 
£>i(r z ). ' 
For 6 = 



j-lu = 0, in which case Di(r x ) 
0, then ri 



7/ - r h x = n tZ = i and D 1 = 
Wj^+ aTl ^ R ^ wr ' 2 ^ which is a decreasing function of r 2 . 
Witnout loss of generality we assume r 2 , y < r 2%x < r 2iZ . 
Then we have D\{r x ) > Di(r z ). 
In either case, D\(r x ) > min{_Di(r y ), Di(r z )}. Hence it is 
sufficient to consider extreme points only. Furthermore, since 
D\ is a decreasing function of r\ and r 2 , we need only focus 
on dominant extreme points. ■ 



We are now in position to solve 0. 

Proof of Theorem We refer with i = 1 (i = 2) 
as problem 1 (2). We solve problem 1. Problem 2 follows 
similarly. 

1. Case I 

Referring to Case I shown in Fig [2] the feasible set Cp x is 
the triangle OEC, which has only one dominant extreme point 
C. By Lemma [3] problem 1 is solved at point C for all w. 

2. Case II 

Referring to Case II shown in Fig [2] Cy X is the quadrangle 
OEBC, which has two dominant extreme points B, C. By 
Lemma [3] D\ = voisx{D l {B),D 1 (C)}. Since B,C are both 
on the line ri+r 2 = 7 (Pi + P 2 ), in order to compare Di(B) 
and D\(C), we plug the line equation and R 2 = 7(Pa) into 
D 1 in © and obtain D 1 = w-^ + -f^[ ^^^±^ + 
w]. Hence we have D\ — D\(C) for w G [0, wi], i.e. problem 
1 is solved at point C for w G [0, w\]. Similarly problem 1 is 
solved at point B for w G (w\, 1]. 

3. Case III 

Following the similar argument in Case II, we can show 
that problem 1 is solved at point A for w G [0, Wi] and point 
B for w G [0, wx]. 

Problem (0 is solved at one of the rate points A, B and 
C according to Table U Therefore, by Proposition |2] the 
completion time pairs shown in Table J] solve problem (0. 



